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PREFACE 



Educators are constantly seeking means to predict the future 
behavior of students* We wish to make these predictions as effi- 
ciently as possible, capitalizing first on student datM currently 
available. This monographi the twelfth in the series, iras pre- 
pared to answer placement questions posed by the Mathematics 
Department and the Junior Dji.yision at Indiana University, 

Perhaps the most significant outcome of this atudy is the 
presentation of expectancy tablea which can be used by advisors 
who have minimal qualif Icatlons in interpretation of statistical 
data. We urge that the results of the use of the tables be made 
available to the Bureau for further atudy and refinement. 

The Bureau of Educational Studies and Testing ia a university- 
wide applied reaearch and evaluation service center. One oil our 
major objectives has been to conduct a series of studies in the 
prediction of student behavior. The first eleven monographs by 
title are: 

No* 1 "Predicting Success for University Freshmen" 

Mo, 2 "Predicting Individual Course Success for Entering 
Freshmen" 

Mo* 3 "The Prediction and Analysis of Grade Achievement 
Behavior" 

No* 4 "Predicting Success for Advanced Graduate Studenta 
in Education" 

No* 5 "predicting Success for Master's Degree Students 
in Education" 

Mo* 6 "The University Freshman Dropout" 

No* 7 "who Shall Persist?" 

Mo* 8 '^ests of English Language as Predictors of Success 
for Foreign Students" 

No* 9 ''An Analysis of Achievement Behavior in the Law 
School" 

No* 10 '^Modern language Placement: An Alternative to 
Testing" 

No* 11 "Freshmen View The College Scene: Opinions Before 
and After the Initial Semester" 
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Many persons have helped In the work of the rather ex- 
tensive research effort. Chief asong these have been Dr, George 
Springer, Chairman, Departnent of liathematlcs j and Mr, Donald 
Brlneman, Assistant Dean of Junior Division, Also, we sincerely 
appreciated the cooperation of the students who participated In 
the study, 

R.C«P. 
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IKDIAK/I STUDIES IK PREDICTION: No. 12 



AN ANALYSIS OF ACHIEVEMENT BEUAVIOR 
IN SELECTED UATKEMATICS COURSES 



Background 



During the academic year of 1967*68 , the Mathematics Da- 
partment and the Junior Division at Indiana University Jointly 
requested that the Bureau of Educational Studies and Testing con- 
duct a criterion-related validity study of the College Entrance 
Examination Board (CESB) Uathematlcs Achievement Tasti Level I, 
for the beginning mathematics courses at Indiana University. 

An ever present problem for counselors and advisors Is the 
correct placement of Incoming students In courses so that the stu- 
dent Is cliallenged and yet can attain an acceptable degree of suc- 
cess. This sonography number twelve In the series of prediction 
studies at Indiana University , addresses Itself to this problem In 
order to provide Information leading to better placement of stu- 
dents In beginning mathematics courses. The criterion of success 
In this project was defined as the final grade received in the re- 



Predlctor variables considered In this study were scores 
on the CEEB mathematics Achievement Test, Level I, and the verbal, 
matbeotfttlcs, aod total scores of the CEEB Scholastic Aptitude Test. 
Other predictor variables were the number of units of high school 
mathematics (Units) which was defined as the number of years during 
which a student was enrolled In mathematics courses and the high 
school rank (HSR) which Is defined as the student's rank in gradu- 
ation class divided by the class size. 

High school rank ras scaled in 'terms of decides. The point 
which defines the top ten percent of a given graduating high school 
class Is called the first decile. Any student who is In the top 
ten percent of his graduating class Is said' to be In the first 
decold^ where a decold is the Interval between any two deciles. 



^A weighting system was used in which an *!a" was given a 
value of 4» "b" a value of 3, "c" a value of 2, *'d" a value of 1» 
and "f" a value of 0. 

^Cbase, C. I., Elementary Statistical Procedures . McGraw 
Hill, 1967. 



spectlve mathematics courses.^ 
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Similarly, the point which defines the next ten percent of a given 
graduating class is called the second decile. Therefore, a student 
who ranks in this part of his class id. said to be in the second 
decoid, ' 



Purposes 



The specific purposes of this project at Indiana University 
were: 1) to determine the relative effectiveness of the liathe- 
matics Achievement Test, Level 1^ as an instrument for placing 
students In beginning mathematics courses; 2) to determine the moat 
effective combination of various predictors of achievement in be- 
ginning mathematics courses; and 3) to d.evelop expectancy tables 
for predicting success in the beginning mathematics courses as an 
aid to advisors in placing students. The purposes were eseentiaXXy 
served by conducting three consecutive studies during the academic 
year 1967-68 • 



Descriptions and Procedures 



The mathematics courses included in this project are de- 
scribed in the following paragraphs and will thereafter be re- 
ferred to by the course number accompanying the description,^ 

A Bevlew of Algebra and Trigonometry (M115) is a five credit 
hour course which does not count toward a degree in the College 
of Arts and Sciences and is described by its title, 

A Partial Review of Algebra and Trigonometry (10.17) is a 
three credit hour course which is also described by its title and 
does not count toward a degree in the College of Arts and Sciences, 

Finite Biat hematics (U118) is a three credit hour course con- 
cerned with set theory 9 linear systems^ matrices , determinants, 
probability and linear programming with applications to problems 
in the social sciences, 

A Brief Survey of Calculus (H119) is a three credit hour 
course providing an introduction to calculus primarily for stu- 
dents in the social sciences. 



^Course descriptions are taken from the 1968-69 College 
of Arts and Sciences Bulletin, Indiana University, 
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Plane Analytic Geonatry (11131) 1b a two credit hour course 
dealing with coordinate systesa, loci, equations of curves, straight 
line, circle, conic sections and general second degree equations. 

Analytic GeoMtry and Calculus I-II (11215-216) are sequen- 
tial five credit hour courses dealing with coordinates, functions, 
straight line. Halts, continuity^ derivative and definite In- 
tegrals, sppllcatlons , circles, conlcs, techniques of Integration 
and Infinite series • 

The Instruaents used In this project are described. In the 
following paragraphs and are thereafter referred to by the abbre- 
viations which accoapany the descriptions. 

The Scholastic Aptitude Test^ (SAT) of the College Entrance 
Bxaalnatlon Board Is a three hour objective test designed to meas- 
ure the developnent of verbal and natheaatlcal skills and yields 
three scores, A verbal score (SAT V) Is the neasure of reading 
coaprehenslon and word-Idea relationships, A matheaatlcal score 
(SAT M) Is the asasuze of pjroblea solving thzx>ugh understanding 
of and reasoning with aath6«atlcsl syabols. The third score soae- 
tlaes used ss a general Indicator of aptitude Is the arlthaetlc 
total of SAT V and SAT U, (SAT TOT), 

The Intended purpose of the test Is the prediction of In- 
dlvlduaZ scadealc perforaance which any be appllsd to adalsslons 
or placeaent functions. 

The Uathematlcs Achlevenent Test, Level (2JSVEL I) of the 
College Bntrance Bxaalnatlon Board Is a one hour objective test. 
It Is a broad rango, cuaulatlve test with approzlaately half the 
focus of the test on algebra and plane geometry. The renalnder 
deals with such topics as coordinate geoaetry, trlgonoaetry, func- 
tions, space perceptions and slaple solids, aatheaatlcal reasoning 
and the nature of proof. The piirpose of the test Is *'to aeasure 
the level of achleveaent In particular subject fields"^ which for 
this test Is aatheaatlcs. 



^A Description of the College Board Scholastic Aptitude 
Test t College Entrance Exaalnatlon Board i 1967-68, 

^A Description of the College Board Scholastic Aptitude 
Test , College Entrance Exaalnatlon Board, 1968-69, 

^Bulletin of lnforaatlon > College Board Adalsslons Test 
College Entrance Eacaaloatlon Board, 1968-69, p, 4, 
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The first study of the project was conduct eck In the fall 
semester of the academic year, 1967-68. The sample consisted of 
all students who received a final grade in MllS^ M117 and 11215 and 
for whom information pertaining to LEVEL I, SAT SAT M scores 
as well as HSR and Units was avatiable, Stxidents receiving grades 
of W (withdrawn) or I (incomplete) and those utilising the pass- 
fail option were not Included in the study. Students receiving 
a grade of W-F (withdrawn failing) were included with those stu- 
dents receiving a final grade of F (failing). The preceding in- 
formation was taken from student files and final grades were ob- 
tained from final grade reports • 

Although there were small Ms, the trends in the means of 
the variables were particularly interesting as all means progress 
in the expected direct ion. The one possible exception is that of 
the average grade which is lower in M215 than in the other two 
courses* Means and standard deviations were generated for all 
variables I distributed by courses and are reported along with the 
respective sample sizes in Table 1« 



TABLE 1. MEANS AND STANDARD DEVIATIONS OF (XXIRSE GRAl£, CEE3 
SCHOIASTIC APTITUDE TEST MATHEMATICS AND VERBAL SCORES, HIGH 
SCHOOL RANK, CEEB MATHEU/VTICS ACHlEVEKflSNT T^T LEVEL I, AND 
UNITS OF HIGH SCHOOL mTUEKb^TICS DISTRIBUTED B7 MATKEUlTICS 
COURSE, STUDY I. 



Course 

H115 H117 M215 

Variable N = 20 N a 59 N a 83 



GRADE 


M 


2.75 


2.76 


2.40 




SD 


1.02 


1.28 


1.11 


SAT V 


M 


423.50 


493.25 


516.64 




SD 


78.29 


88.81 


80.02 


SAT U 


11 


512.50 


560.00 


626.31 




SD 


62.06 


73.95 


65.73 


HSR 


M 


3.70 


2.40 


1.80 




SD 


2.40 


1.70 


1.50 


LEVEL I 


M 


487.00 


531.36 


609.04 




SD 


60.36 


72.65 


71.86 


UNITS 


M 


3.10 


3.36 


3.68 




SD 


•72 


.58 


.49 
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A limitation of the results in this first study resulted 
froB the general lack of cottplete sets of predictive neaaures on . 
sufficient sanple sizes, particularly for LEVEL X scores. As a 
result of the snail sanple sizes in the first study it was decided 
to conduct a second study to provide laore Information relative to 
the LEVEL I test. 

Since it was apparent that few additional subjects with 
LEVEL Z scores as a predictive measure would become available, the 
LEVEL I test was administered in conjunction with final examina- 
tions concluding the spring semester. Two parallel forms of the 
LEVEL I test were provided by the Educational Testing ^Service for 
this purpose. An Important distinction between this study and the 
previous one is that I£VEL I is a "concurrent" measure rather than 
a predictive one, 

Data for this study consisted of HuSR, SAT V, SAT M collected 
from student records; the final course grade collected from final 
grade reports; and the USVEL I score from the end"*of -course 
administration, Sai]q;>les for this study consisted of those students 
enrolled In M115 and U117 during the spring semester of the academic 
year 1967-68, and for whom complete data were available. Again, 
students utilizing the pass-'fail option or receiving grades of I or 
W were excluded from the study. Those receiving grades of W-F 
were included and were pooled with those receiving a grade of F, 
A possible source of bias in this respect Is the exclusion from 
the study of those students who as a result of impending failure 
in the course did not take the final examination and consequently 
the LEVEL I test. 

Again, the same trend in means of the variables was evident. 
All means progress In the expected direction with the exception 
of the mean grade for the students in M117 which is lower than that 
of M115, Means and standard deviations for each variable within 
a given course are presented in Table 2, 



ERiC 



6 



T&BLS 2. UEANS AND SlAHmRD DEvIATlCOfS OF COURSB GR/IDB, CEEB 
SCHOLASTIC APTITUDE TEST MATHEMATICS AND VERBAL SCORES, HIGH 
SCHOQI. BANK AND CEEB UATHEUATICS ACHIEVEUENT TEST I£VEL I 
DISTRIBDnD BY UATHEUATICS COURSE p STUDY II, 



Course 



V&rlable 




lais 

N = 211 


H117 
N a 154 


GBADB 


U 


2.59 


2,31 




3D 


1.11 


1,22 


SAT V 


U 


484.10 


496*32 




SD 


95.14 


89,12 


SAT M 


tt 


493,30 


548,87 




SD 


95,52 


78,81 


HSR 


M 


3,20 


2,70 




SD 


1,90 


2,00 


LEVEL I 


It 


503,76 


529,77 




SD 


78,36 


70,47 



The third and final study of this project was conducted as 
a result of decisions made on the basis of the two previous studies. 

The samples consisted of all students enrolled in iai5, iai7, 
M118, UX19, UlSl, M215 and U216 during the academic year 1967-68 
for whoa SAT Vp SAT Mp SAT TOT, HSR and final course grade could 
be obtained and p in part, overlaps with the sanples in the first 
two studies. Exclusions froa the study were the save as for the 
previous studies and students receiving grades of W-F were pooled 
with those receiving grades of F, 

Trends in the means were generally similar- to the trends 
in the previous studies. One rather consistent exception to these 
trends was iai9 in which student performance was very high, 

Means and standard deviations classified by course are 
presented for each variable in Table 3, 
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These data were used to generate expectancy tables and mul- 
tiple linear regression equations for predicting success in the 
various oaatheioatlcs courses Included in this project • Tables and 
equations will be presented in a later section of this monograph. 



Results 



In each of the studies further analysis consisted of zero- 
order intercorrelations betveexi all variables within a given study 
distributed by course. In addition a stepwise multiple linear 
regression technique was employed to generate multiple linear 
regression equations and multiple correlation coefficients for 
predicting achievement in the respective courses from a weighted 
combination of the various prc^dictor variables. 

In a stepwise multiple regression approach the variable 
selected at the f iarst step is the one which makes the greatest 
reduction in the residual sum of squares. At each successive 
step a variable is selected in such a maziner as to provide the 
greatest reduction in the residual sum of squares when taken in 
combination with the subset of variables selected by the previous 
step. 

An alternative to allowing the variables to enter the re- 
gression equation in a stepwise manner is to control their entry 
by s^^ecifying the order of entry. In study I, all predictor vari- 
ables were allowed to enter the regression equation in a stepwise 
ma4iner except I£VKL I« which was suppressed until the last step. 
The effect was to provide information regarding the increase in 
predictive power due to the addition of LBVKL I, over all other 
variables. 



STUDY I 



The sample for M115 consisted of only 20 Ss which was con- 
sidered too small for regression analysis. The sample for 11117 
consisted of 59 Ss, It can be noted that SAT M correlated the 
highest with the criterion followed by JXVEh I, HSR, lAilts and 
SAT V respectively, (Table 4) 

When one considers the summary regression table in which 
all predictor variables were allowed to enter in a stepwise manner 
(Api>endix A), it is observed that the order in which the predictor 
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variables entered the equation was SAT M, Units, HSR, LEVEL I and 
finally SAT V« This nmy be accounted for In part by the correla-- 
tlon of .58 between SAT M and L£VBh I. 

The multiple correlation (R) between all pi'edlctor varlablciiS 
and the criterion la .72 while the value for SAT Units and HSR 
aa predictors of GRADE Is .69. The variables SAT V and I£VEL I 
apparently add little to the predictive power. This Is further 
evident when one considers the reduction In the standard error of 
estlaate of .95 for SAT Units and HSR as opposed to .93 for 
all variables (see Appendix A), 

By forcing UBVEL I Into the equation last, It Is seen that 
very little Is addec^ to the predictive power. This Is seen by the 
snail Increase In the nultlple correlation and tUe small reduction 
In the standard error of estimate (Appendix A), 

The multiple linear prediction equation for IU17 using all 
variables Is presented in Appendix B« 

The sample for 11215 contained 80 Ss, All correlations be- 
tween the predictors and the criterion were low with I£V£L I 
having the highest correlation of .35 (see Table 4)« Interestingly 
enough when allowed to enter the regression equation In a stepwise 
manner, LEVEL I entered first while SAT U was the last to enter • 
The order In which the Intexvenlng variables entered was SAT V, 
HSR, and Units • 

The fact that SAT M was the last to enter may be partially 
explained by the Intercorrelatlon of «64 between LEVEL I and 
SAT M. The relative order of HSR and SAT V remains the same as 
for Mil?; however, Units is of a lower priority. This is not 
totally unexpected since placement in the various courses is con- 
tingent upon Units. For students placed in U215 the distribution 
of Units has a more restricted range of possible values than for 
Mild or Mil? (see Tables 1, 2 and 3). 

tlie fact that LEVEL 1 enters the equation first indicates 
that it is the most effective in reducing the residual sum of 
squares • This is supported by forcing I£VEL I to enter the 
equation last and noticing the 6 percent increase of criterion 
variance accounted for and the accoapftnying, although relatively 
small, reduction in the standard error of estimate* 

The question is now raised as to the efficacy of I2VEL I 
as opposed to weighted combination of SAT H and HSR. When 
LEVEL I is allowed to enter the equation first, the correlation 
is .35 which is significant at the .01 level of significance. 
LEVEL I accounts for 12 percent of the criterion variance and 
when HSR, SAT V, Units and SAT U are allowed to enter the equation 
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first they account for an additional 2 percent of the criterion 
variance • The corresponding decrease in the standard error of 
estinoate is negligible (Appendix A), Thus, LEVEL I alone pro- 
vides as much infomation as all variables taken together. If 
no information regarding LEVEL I were available (simulated by 
forcing I£VEL I tc enter the regression equation last) it is noted 
that SAT U enters the equation first followed by HSR, These two 
variables taken together produce a multiple R of •28 which is 
significant at the .05 level with a standard error of estimate 
of 1.08. These two variables account for slightly more than 
8 percent. of the criterion variance. It can further be seen that 
SAT V and Units add little to the predictive power of this mul- 
tiple regression equation. Therefore, USVEL I alone accounts for 
12 percent of the criterion variance with an accompanying standard 
error of estimate of 1*05 which is an increase of 4 percent over 
the 8 percent of accounted-for variance produced by the weighted 
combination of SAT M and HSR, The ,03 error In estimated grade 
advantage for I£VEL I (1,08-1,05) over SAT M and HSR is considered 
to be negligible. 

In summary 9 the information obtained served as a prelimi- 
nary indictment against LEVEL I on the basis of the small return 
realized from the cost in time and money necessary to collect the 
data. 

The multiple prediction equation using all variables is 
presented in Appendix B, 
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XABLB 4. ZERO ORfiBR UTTERCORREIATIONS BETWEEN ALL VARIABUSS AND 
IIDLTIFUE CORRELATION C^QEFFICIEHTS BBTVEBH ALL PBEDICKA VARI- 
ABLES AKB QBAnS DISTRIBDTBO BY HATHSUATICS OOURSE» STUD7 I« 



Varlataet» SAT V SAT H HSR ISVEL I tlNITS 



M117 <N a 59) 

«■ 

GRAOB .33 .60 -.41 .52 «34 

SAT V ,31 -.25 ,27 -.06 

SAT M -*.28 .58 .13 

HSR -.18 -.22 

LBVBL I .26 



IfULTIPUB GORRBIATIQN i= .72 



11215 (N s 83) 



GRADE \08 .23 -.23 .35 -.08 

SAT V .44 -.35 .48 -.11 

SAT H -.34 . 64 -.17 

HSR -.45 .22 

LEVEL I -.04 

UULTIFUB CORRELATION a .38 



STUDY II 



The data were not available to analyze further USVBL I as 
a predictor variable. The only workable way for analysis of 
USVEL I as a predictor of GRADE was to administer I£VXL I as a 
posttest to students enrolled in eacll Bathenatics course. Bow- 
eve r, in order to gain some insight :lLnto the relationship between 
LBVBL I, SAT M and GRADE, LEVEL I was administered in conjunction 
with final examinations in iai5 and iai7 during the spring 
semester. 

n^e sample tor iai5 consisted of 211 Ss for whom complete 
data were available. In this study I2VBL Z was administered as 
A concurrent validity measure rather than a predictivw measure. 
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The zero oi^er cor relations of SAT M aiv£ LEVEL I with the 
criterion were ,46 and .45 respectively, follov^ed by HSR and 
SAT V« A most revealing correlation is the one between SAT M, a 
predictive measure and LEVEL I, a concurrent measTu*e, the nagni* 
tude of which is ,71 (see Table 5)« Since I£V1SL I is not a pre- 
dictive measure, only SAT HSR and SAT V were a]llowed to enter 
the multiple regression equation and they entered in that order* 
The multiple correlation using all thk^^ predictois was .56 with 
a standard error of estimfi^te of •93« If only SAT U and HSR are 
considered, the multiple correlation is .55 with a standard error 
of estimate of •94. It is, therefore, obvious that SAT V adds 
little to the predictive power. 

The multiple regression equation using SAT M and HSR is 
pi«esented in Appendix B« 

In the data for M117 the zero order correlations between 
the respective variables and the criterion lacked the general 
consistency heretofore exhibited, HSR with a correlation of *57 
(disregarding the negative sign) was highest followed by I£VEL I, 
SAT V and SAT M (see Table 5), However, consistency was seen in 
the relatively high correlation between SAT H and LEVEL I, .61 . 

HSR was selected first by the stepwise routine in multiple 
regression followed by SAT M which increased the correlation (R) 
to .59. When SAT V was included, the multiple R was •60« Al- 
though HSR produced the greatest single reduction in residual 
score variance, consistency was exhibited in that SAT V added 
little to the predictive power* 

The multiple linear regression equation for predicting 
GRADE from SAT V, SAT M and HSR is presented in Appendix B« 

31215 is the first semester course of a two course sequence 
and hence no data were available for M215 in this study during 
the spring semester* 
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^BU 5. ZBRO ORDER IlTrSROORREIATIOKS BETWEEN ALL VARIABLES AND 
S£ULTIPIJS CORRELATION COEFFICIENTS BETWEEN AU. PREDICTOR VARI- 
ABLEST AND GRADE DISTRIBUTED BY MATHEMATICS COURSE, STUDY II. 



Variable SAT V SAT M HSR LEVEL I 



M115 (N 211) 

GRADE .17 .46 -.39 .45 

SAT V .44 -.33 .30 

SAT M -.20 .71 

HSR .23 

&IULTIPLE CORRELATION = .56 

iai7 (N s 154) 

GRADE .37 .36 -.57 .50 

SAT V .50 -.41 .41 

SAT M -.38 .61 

HSR ,36 

MULTIPLE CORREZATION = .60 



^LEVKL I was not a predictor variable and was not Included In 
the multiple correlation. 



In view oi the consistently high correlation between SAT M 
and LEVEL I scores, the £act that for LEVEL I to be a predictive 
measure It would have to be administered as a pretest to those 
enrolled In each course and that SAT M and HSR were consistently 
the best predictors of GRADE to the exclusion of the SAT V, it 
was decided that approximately as many error free placement decl- 
islons could be made using predictive measures SAT M and HSR. 
Exclusion of SAT V from the multiple prediction equation Is sup- 
ported by the consistently high Interc or relations between SAT V 
and SAT M, the subsequent small Increase in the multiple R and 
the corresponding small reduction In the standard error of 
estimate. 
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STUD7 XXX 



Xn study XXX the course enrollments varied from 107 In 
M131 to 448 In U215 (see Table 3)« The data for these seven 
courses were relatively consistent, Xn making contrasts, mul- 
tiple correlations using skT TOT and HSR as predictors were com- 
pared to those using SAT V, SAT U avid HSR to determine which 
combination of variables would be tbe best predictor of GRADE, 
Criteria used to make this determination were criterion variance 
accounted for by the weighted combinations of the variables and 
the reduction of the standard error of estimate. 

In each case the multiple correlation obtained 1^ using 
SAT V, SAT U and HSR was as great as that obtained by using 
SAT TOT and HSR. Further, the standard error of estimate obtained 
by using SAT SAT V and HSR was approxlioately the same as that 
obtained by using SAT TOT and HSR (see Table 6), One notices that 
in every case where the multiple correlation is obtained by using 
Si^T V, SAT H and HSR, SAT V is the last to enter the equation and 
never adds more than one percent of accounted for criterion vari- 
ance, Xf at all, it only slightly reduces the standard error of 
estimate. 



Another Interesting finding from these data was the moder- 
ately high intercorrelation between SAT M and SAT V (median r m ,48), 
TtiXB corroborates the evidence present'Od regarding its selection 
for the regression equations, 

Xn courses M115, M118 and iai9, SAT M entered the regression 
equation first, followed by HSR, In courses Ull?, M131, M21S and 
M216 the order of entry was reversed. Examination of similarities 
of course descriptions failed to explain this reversal. 
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TABLE 6. ZERO ORDER INTERCOBRBIATXQNS BETWEEN ALL VARUBIfS AND 
UDLTIPLB OORREIATI(»(' COEFFICIENTS BETWEEN A WElQIfrED COMBINA- 
TION OF HIGH SCBCX)L RANK AND C2EB SCHOIASTIC APTITUDE MATKE- 
UATICS SOOBE AS PRBi)ICTORS OF GRADE DISTRIBUTED BY MATHEMATICS 

COURSE, sTUinr iii. 



Variable GRADE SAT V SAT M SAT TOT HSR 



M115 (N a 402) 



GRADE 1.00 .26 .49 .43 -.44 

SAT V 1.00 .48 .87 -.31 

SAT M 1.00 .85 -.25 

SAT TOT 1.00 .33 

HSR 1.00 

UULIIPZiB CORRELATION = .59 

M117 (N » 412) 

GRADE i.OO .27 .40 .39 -.47 

SAT V 1.00 .45 .88 -.33 

SAT M 1.00 .83 -.30 

SAT TOT 1.00 -.37 

HSR 1.00 

MULTIPLE CORRSIATION a .54 

M118 (N a 297) 

GRADE 1,00 .26 .39 .38 -.36 

SAT V 1.00 .44 ,87 -.34 

SAT M 1«00 .83 -.27 

SAT TOT 1.00 -.36 

HSR 1,00 

BOnLTIPLE CORREZATION » .47 

M119 (N a 149) 

GRADE 1.00 .20 .27 .27 -.22 

SAT V 1.00 .50 .89 -.42 

SAT M 1.00 .84 -.21 

SAT TOT 1.00 -.38 

HSR 1.00 



MULTIPLE C0RR£LATI(»7 a .31 
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TABLE 6 (Continued) 



Variable 


GRADE 


SAT V 


SAT M 


SAT TOT 


HSR 


M131 (N :s 107) 












GRADE 


1.00 


.21 


.33 


.31 


-.53 


SAT V 




1.00 


.45 


• 88 


-.32 


SAT M 






1.00 


. .83 


-.06 


SAT TOT 








1.00 


-.23 


HSR 










1.00 



MULTIPLE OORREIATIOH = .61 

U215 (N = 448) 



GRADE 


1.00 


.25 


.33 


• 33 


-•36 


SAT y 




1.00 


.48 


.89 


-.31 


SAT M 






1.00 


• 83 


-.32 


SAT TOT 








1.00 


-.37 


HSR 










1.00 



MULTIPLE CORREIATION =: ^42 

M216 (N =: 238) 

GRADE 1^00 ^14 ^14 ^16 -•24 

SAT y 1^00 ^57 .91 -.34 

SAT M 1.00 .85 -.30 

SAT TOT 1.00 "-•36 

HSR 1^00 

MULTIPLE CORR£LATI(»{ = ^25 



Expectancy tables tor predicting success as measured by 
course grade for each course contingent upon SAT M and HSR have 
been constructed on the basis of actual performance by those stu«- 
dents Involved In this study^ These tables are presented for each 
course In Appendix Multiple linear regression equations using 
HSR and SAT M as pz«dlctors of GRADE are presented for each course 
in Appendix 
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SummaxTy and Conclusions 

The Bureau of Educational Studies and Testing was requested 
by the Uathematlcs Department and the Junior Division at Indiana 
University to conduct a criterion related validity study o£ achieve* 
saexxt in beginning aoatheiKatics courses during the academic year of 
1967*68, Preliminary investigation revealed that the correlation 
between SAT M and LEVEL I, both predictive loeasures, was high. 
However, some ambiguity ^as Introduced as LEVEL I contributed 
little to the predictive power of GBADE over a weighted combination 
ox i^AT M and HSR in M117 but entered the regression equation first 
In M2i5. 

In ld215, LEVEL I alone accounted for 12 percent of the 
criterion variance with a correlation of .35, significant at the 
•01 level, SAT U and HSR, with a multiple R« of •28, significant 
at the •OS level accounted for 8 percent of the criterion variance^ 
The difference of •OS of an estimated grade between the standard 
error of estimate was considered of little consequence^ The 4 per- 
cent advantage of LEVEL I over the weighted combiziation of SAT M 
and HSR hardly seemed to justify the expense in time and money 
which would have to be incurred due to administrating the LEVEL I 
test to all students enrolling in mathematics^ This was especially 
true when one considers the ambiguity revealed by the data from 
Bai7^ 

In Study II more information was sought concerning LEVEL I 
before a decision concerning its validity could be reached • Con- 
sequently, it was administered in conjunction with final examina- 
tion in Mils and U117 in the spring semester of the academic year 
1967*68 • The correlations between SAT M as a predictive measure 
and LEVEL I as a concurrent measure of ^71 and •ei for U115 and 
iai7 zespectively tended to corroborate the decision to rely on 
SAT M and HSR rather than I£VEL I for decision m&king purposes • 

On the basis of these decisions attention was focused on 
SAT V, SAT U, SAT TOT and HSR as predictors of achievement in 
courses IU15, U117, U118, M119, H131, U215 and M216^ 

All subjects enrolled in these courses during the academic 
year 1967-68 for whom complete data were available with those 
exceptions noted in an earlier part of the study were included in 
the analysis • 

In each case, SAT M and HSR were as effective as SAT TOT 
and HSR on the basis of the multiple correlation and the standard 
error of estimate. Further, in no case did SAT V add more than 
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1 percent to the accounted for criterion variance nor decrease the 
standard error of nultiple estimate by more than .01 of a grade 
unit. Hance, it was decided that the most efficacious combina- 
tion of predictors of achievement in beginning mathematics courses 
was SAT U and HSR. The order in which these two variables entered 
the multiple regression equation was SAT M and HSR respectively | 
for H115, M118 and M119 and the reverse for iai7, IU31, M215 and ; 
M216, 

Prediction equations and eapectancy tables for predicting 
success based on SAT U and HSR were generated for each course 
and are presented in Appendix B and C respectively. 
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APPENDIX A 



Appendix A provides siuuary tables of the stepwise multiple 
regression technique for each course within each study. This in- 
formation is presented in order that the reader may examine the 
rationale behind the decisions made in this study • 

The step number indicates the order in which the variables 
were selected • Each variable is selected in such a way that when 
combined with the variables of the previous step the greatest re* 
duction in the residual sum of squares occurs • 

The multiple R is an index of the relationship between the 
predictors and the criterion. The square of the multiple R gives 
the proportion of criterion variance accounted for by that combina- 
tion of predictors. The increase in RSQ allows one to assess the 
contribution of the last variable in terms of accounted for 
variance. 

The standard error of estimate allows one to establish a 
band about the predicted grade within which the actual girade of a 
certain percent of students should fall. 
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SmoAfCt TABLES OF STEPWISE ICULTXPLE REGRESSION 
PBOCEJXIRB CIASSIFIED BY CXXJHSE WITHIN STUDIES. 



STUDY X 



rXSfJ^ 7. ALL PaKDlGTOa VARIABLES WERE ALLOWED TO ENTER THE 
EQUATION IN A STEPWISE UANNER, 



STEP 


VARIABIf 






INCREASE 


S.K. 


NUMBER 


ENTERED 


a 


RSQ 


IN RSQ 


SSTIU4TE 


Mil? (N m 


59) 










1 


SAT M 


• 60 


• 36 


• 36 


1^03 


2 


uHITS 


• 65 


•42 


• 06 


•S8 


3 


HSR 


• 69 


• 48 


• 06 


•95 


4 


LEVEL I 


• 71 


• 50 


• 02 


.94 


5 


SAT V 


•72 


• 52 


• 02 


•93 


M2I5 (N a 


83) 










1 


LEVEL I 


• 35 


• 12 


• 12 


1.05 


2 


SAT V 


•36 


• 13 


• 01 


1.05 


3 


HSR 


•37 


• 14 


• 01 


1^05 


4 


UNITS 


• 38 


• 14 


• 00 


1^06 


5 


SAT U 


•38 


• 14 


• 00 


1^06 
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TABLE 8. PHEDICTOR VARIABLES SAT V, SAT H, UHITS AND HSR WERE 
ALLOWED TO ENTER IN A STEPWISE MANNER, LEVEL I WAS FOECEP INTO 
TUB EQUATION lAST, 



STEP 


VARIABLE 






INCREASE 




NUMBER 


ENTERED 


R 


RSQ 


IN RSQ 


ESTIMATE 


M117 (N =s 


59) 










1 


SAT M 


• 60 


• 36 


.36 


1^03 


2 


UNITS 


.65 


• 42 


• 06 


• 98 


3 


HSR 


• 69 


• 48 


• 06 


• 95 


4 


SAT V 


.70 


• 49 


• 01 


•95 


5 


LEVEL I 


.72 


;,52 


«03 


.93 


M21S (N » 


83) 










1 


SAT M 


«23 


• 05 


• 05 


1^09 


2 


HSR 


• 28 


• 08 


• 03 


1^08 


3 


SAT V 


• 29 


• 08 


• OX 


1^09 


4 


UNITS 


• 29 


• 08 


• 00 


1^09 


5 


LEVEL I 


•38 


• 14 


• 06 


1^07 






STUDY 


II 






TABLE 9. 


ALL PREDICTOR VARIABLES WERE ALLOWED TO ENTER THE PRE- 


DICTION EQUATION IN A STEPWISE MANNER. 






STEP 


VARUBLE 






INCREASE 


S.E. 


NUMBER 


ENTERED 


R 


RSQ 


IN RSQ 


ESTIMATE 


Mils (N 3 


211) 










1 


SAT U 


• 46 


.21 


• 21 


l.OO 


2 


HSR 


• 55 


• 30 


• 09 


• 94 


3 


SAT V 


• 56 


• 31 


• 01 


«93 


M117 (N « 


154) 










1 


HSR 


• 67 


•32 


•32 


l^Ol 


2 


SAT M 


• 59 


• 35 


•03 


• 99 


3 


SAT V 


• 60 


• 36 


• 01 


• 99 
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TABLE 10« AU. FRfiDXCTOR VARIABLES VERS ALLOVBD TO ENTER THE »B- 
DICTION EQUATION IH A STEPWISE MNNER. 



STOP 
MTJUBER 


VARXABLB 
ENTERED 


R 


HSQ 


INCREASE 
IN RSQ 


&•£• 
ESTIMATE 


Mils (N s 


402) 










1 


SAT II 


•49 


• 24 


•24 


1^03 


2 


HSR 


• 99 




• ^x 


• 99 


3. 


SAT V 


•59 


• 35 


• 00 


• 95 


M117 (N = 


412) 








• 


1 


HSR 


•47 


• 22 


• 22 


i ioe ; 


2 


SAT U 


• o% 




• vt 


1 oi 


3 


SAT V 


• 55 


•30 


•01 


1^03 


Mils (N 3 


297) 










1 


SAT M 


•39 


• 15 


• 15 


1^02 


2 


HSR 


•47 


99 


IV7 

• U7 


■OA 


3 


SAT V 


•47 


• 2S 


• 00 


•98 


M 119 (N » 149) 










1 


SAT U 


•27 


• 07 


• 07 


1^08 


2 


HSR 


•31 


• 10 


•03 


1^07 


3 


SAT V 


•32 


• 10 


.00 


1^07 


lasi (N a 


107) 










I 


HSR 


• 53 


• 28 


•28 


• 97 


2 


SAT U 


•61 


• 37 


• 09 


.92 


3 


SAT V 


•61 


• 37 


•00 


•91 


M21S (N s 


448) 










1 


HSR 


«36 


• 13 


• 13 


1^11 


2 


SAT U 


•42 


.18 


.05 


1.08 


3 


SAT V 


•43 


• 18 


• 00 


1.08 



o 
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TABLE 10 (Continued) 



STEP 


VARIABLE 






INCREASE 


S.B. 


NXniBER 


ENTERED 


R 


RSQ 


IK RSQ 


ESTIMATE 


11216 (N 


» 238) 










1 


HSR 


•23 


.05 


• 05 


1,14 


2 


SAT M 


•25 


• 06 


.01 


1.14 


3 


SAT V 


• 25 


.06 


• 00 


1.14 
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APFBNDIX B 



In Appendix B are presented tine regression equations for 
predicting the final grade In a given inathe«atlc8 course using 
aathenatlcs scores on the SAT and high school rank exj>re8sed as a 
decold* For exaaple^ let us predict the grade of Isaac In MX31 
when his 5\T H score Is 400 and his HSR Is His predicted 

grade Is than found by completing the following computation: 
PBB0^C1ZO GRADE equals •0046£> (400) - .32449 (3.2) -i^ .47446. This 
vAliae when computed Is 1^30 to two significant figures. By adding 
and subtracting the standard error of estimate of «92 a predicted 
grade range from ,38 to 2,32 Is obtained. Approximately two- 
thirds of the students who have a weighted combination of SAT U 
scores and HSR equal to Johnny's will have actual grades within 
this range. 
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STUDY I 

tABUB 11, KDI/riPLE LiKEMt RBGBXSSXOM SQUATIOHS FOR FRSDIGTIMQ 
OOUBSS OBASB, 

Standard error 
Equation ot estlsate 

1. Mil? (N = 59) 

• 00179 (SAT V) + . 00634 (&*.T U) + 

• 00331(LBVKL I) •45743(UNITS) - 

•14728(HSR) - 4.60678 = PBEDICTED GRADE .93 

2. U21S (91 « 83) 

-•00194 (SAT V> -I- .00046 (SAT II) 

• 00537 (7JEVEL I) - .11885 (UNITS) - 

• 07839 (USR) .42046 « PREDICTED GRADE 1.06 
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STUDY II 



TASUR 12. WJLTIPUB LINEAR REGRESSION EQUATIONS FOR PREDICTING 
COURSE GRADE, 







Standard error 




Equation 


of estlnate 




Mils (N » 211) 






-•00162(SAT V) -1- •00519(SAT M) - 






• 20113(HSR) -1- 1.45841 => PREDICTED GRADE 


•93 


2. 


iai7 (N - 154) 






•00145 (SAT V) -I- .00201 (SAT M) - 






•29677(HSR} + 1.31265 » PREDICTED GRADE 


• 99 
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STUDY III 

13. ICULTIPLB LXKEA.R REGRESS IQM EQUATIONS FOR PREPICTING 
COURSE GRADE, 



Standard error 
Equation of estiiaate 

!• HIIS (N 402) 

» 00526 (SAT M) - .20545 (HSR) + .54792 

PREDICTED GRADE .95 

2. HIl? (N 13 412) 

• 00456(SAT M) - •24756(HSR) .51153 b 

PREDICTED GRADE 1,03 

3. Mils (N 9 297) 

• 00445 (SAT H) - .18063 (HSR) + .25343 ^ 

PREDICTED GRADE .98 

4. kl.19 (N 149) 

.00316 (SAT M) - .14417 (HSR) + .98533 

PREDICTED GRADE 1.07 

5. ia31 (N s« 107) 

.00465 (SAT U) - ,.32sM9(HSR) + .47446 = 

PREDICTED GRADE .92 

6. 11215 (N » 448) 

.00388 (SAT M) - .20949 (HSR) -t- .39675 a 

PREDICTED GRADE 1.08 

7. U216 (N a 238) 

.00122(SAT M) - .18941(HSR) 4- 2.05473 » 

PREDICTED GRADE 1.14 
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AFFSNDXX C 
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APPENDIX C 



Appendix C presents expectancy tables based on SAT H 
scores and HSR for each course • 

These tables show frequencies, cximulative frequencies and 
cumulative percents of students whose SAT M scores fall within 
a given ran^ and whose HSR expressed as a decoid fall within a 
givan range that achieve a grade of A, B, C, D or F in a given 
mathematics course^ 

For example, of the thirty-nine students in laiS whose 
SAT M scores were from 500 to 549 and whose HSR was in the first 
or second decoid seventeen students, or forty-four percent re- 
ceived A* s. Twenty-six cf the thirty-nine, or sixty-seven, per- 
cent received A's or B's while virtually one hundred percent of 
those students received grades of A, B, or C, 




Sr» t» a o 
00 0) Cft o 
H 



^ N « p 9 

"9 (0 CI O O 



lA o o o P 

H TP N P 5 



QOCiAPH C9ooor«r« noo^oo 



H d C9 



00 ^ 



OOHP niO(0<DP 



2^:222 wNwpp coi^cocop 

^(oopo C9tf>ppp f-iooa>o>o 

H H H H H H 

r^PmotO) p^ior«r« c^co^^io 

HC^ncOCO HHHH 

t^AOPP PPH:«|0 C9HHPH 

NPCOPP POOPPP POOHPP 

NiOAPP p-tCOPpP C9PPP 

H H H 

PiOiAPt^ COHppp C^PC^F-tP 

Hi-tdN i-tC9nn 

ppOHH coppt^n CIP09PIO 



C9 ^ 10 H P 
C9 ^ t« P P 



P *A Q 

^ p 5 



t^^^pN nppmp PC9t*u)H 

H N C9 n N n n h n ^ 

t«t«pion nPt*p€o poiiopp 

_j _j _j ^ 



<POQ(^ <nup»N <aoQ»i 



t 



<0 



I 

10 



o 



8 

I" 



ooto^OiO eor^iOQOo oooontop 

f4 f4 M 

C4CSic4cor^ p-ioioooci Ni(ttN<q(p-i 



C4 O O « M 

^ CO i-l 



p-l <-< (O C4 C4 
CM :0 CM 1^ 



^ to C9 CM 
CM H 



3$ 



moooo ^cooioQ onoop 

e4r«o>oo Hindoo Hn<pooo 

r-l H r-l r-l 

m^moo u>co^i-<^n c^Oaoioo 

r-lrlNCM CMCO^^ H^«« 

lOOiiOHO tot^Ht^eM coNQOt^m 



P 



mmo^AQ r«ioo)0)Q or^OMp 

iH 1 i H 

C0f-l5lt0»O CM^(D^N OCOHOiM 

f-IHr-lCM f-I^CM HCO^ 

OfiPOiAp-l CMCMCMQOtO OCOOOOSCM 



<auaik, <aua«M ^auQh 



38 



i 



is 

M O 

M 

=1 



o 

s 

00 M 



o. 



fli 



9Q I 



QOt^COQO (•ACDQOO IN^AC40 

C9«0>OO iH^QQOiO H^«r9G)0 

H H H H 

QOOiOOCOCO «»OHCO «»lOC0« 

SP-ioioo (oo^p-ici ^oo>aoco 

H CO r> iH i-» 



o o o o o 

H <0 00 o o 



^ 0> CO N g 



O 00 Ok 00 o 
iH lO 00 O 



5#« v# »^ 

C9 00 0) 

n n n n 

HCOOOOO Ht^ON^ OCOOlOt> 

HCII0C90 Hcoeocici ocot^mci 



(ociooo ooeooo 

M to 00 O CO 0) O 

iH H 



CI 



H4-«OC9H HfOiPNW OONC9C9 



<AOQ»^ ^ m O Q 9n 4^ SQ O Q P4 



t 



H 

I 

s 
& 

o 

8 
S 

V 



erJc 



i 

5 



8 n 



as 



as 

M CO 



ii 



as 



00 ^ 



IX 

o 



ca 1 

S' 

M 



<0 0> ^ C4 ^ 
C4 H iH 



S(0 0) 
C4 



• •••• 

oracicon Onr^t^oo 

ONOHO OCO^OH 



f 



ERIC 



40 



o 

o 

o 

00 «H 



0) 

8" 



• •••• ««••• 

OfHdOO HHH^CI 



CO : 



U { 

a 



I 

CM 



ERIC 



a 


rH 




rH 




O 


00 


rH 


00 


O) 


O 




0> 


n 


O 




to 




O) 




O 


w 






00 


O 




CD 


00 


O 












rH 










rH 








rH 




00 




00 


O 


in 




9> 


in 


in 


<0 


o> n 






n 




iC 




(0 


00 


00 


rH 


CO 




00 


0) 














rH 


rH 


rH 


rH 






















00 


(0 




C4 










o 


rH 




rH 




<o 






(0 




rH 




rH 


C4 


fO 


rH 


H 


iH 




rH 


rH 



NO)OQ lAiAOlOQ OOOHOOO 
(OQOOO HCI<0Q0O fHt^QOO 



Hoitoaoco eoioc4NO onc4tot* 

Hi-4HrH HfHd Hf^i-I 



i-ciH^No wcit^wn onoiON 



o in o 
N ^ o 



OOfHrHH ON^lOt^ OniOHH 



oOfHOo ocie^Hci oncitoo 



<0)OQp^ <0)OQP^ <AaQPN 



7 



I 



ft 

o 



s 



to VI 

to 



H i-l «D 
CO ^ 00 



«0 O 



N CO « 

n f o 



^ O) 
CO CO ci 



C9 tf) 



m o o 
M CO c« a» o 



H O M CO M 
H CO <0 flO 



H » H C9 00 
H H CO H 



o 

1 « 



to o o o o 
• •»«• diAoooo 

HCttOQOOO Q0t0<«<h>0 

H 01 e« «o 



Hr4^0lO Q0C«iOkeOCO 



to I 

I' 



I 

€9 



